Add AgentX cumulative convergence diagnostics / 新增 AgentX 累计收敛诊断#2296
Draft
cquil11 wants to merge 2 commits into
Draft
Add AgentX cumulative convergence diagnostics / 新增 AgentX 累计收敛诊断#2296cquil11 wants to merge 2 commits into
cquil11 wants to merge 2 commits into
Conversation
Compute retrospective cumulative-prefix stabilization for P75/P90 TTFT, end-to-end latency, and interactivity while preserving the existing fixed-window diagnostics. 中文:为 P75/P90 TTFT、端到端延迟和交互性指标新增回溯性累计前缀收敛诊断,并保留现有固定时间窗口诊断。
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
request_metrics.stability.convergenceand add boundary, reciprocal-symmetry, insufficient-duration, late-excursion, horizon, and sample-count tests.Statistical interpretation
This is a retrospective diagnostic of convergence within one run. It is not a confidence interval, a rerun prediction interval, or a substitute for independent randomized repetitions. The displayed span is the range of cumulative estimates after stabilization, not the total range of individual requests or fixed windows.
The band is evaluated with absolute log ratios, so latency and its reciprocal interactivity stabilize at the same checkpoint.
Companion rollout
?unofficialrun=overlays.agentx-uncertainty-db-mvp(br-wandering-pine-aih0gnca); production remains untouched.Validation
python -m pytest utils/agentic/aggregation/test_stability_metrics.py utils/agentic/aggregation/test_process_agentic_result.py— 47 passedgit diff --check— passed中文说明
request_metrics.stability.convergence下保留清晰的嵌套结构,并补充边界、倒数对称性、时长不足、后期越界、完整时间范围及样本计数测试。统计解释
该指标是对单次运行内部收敛情况的回溯性诊断,并非置信区间、复跑预测区间,也不能替代独立随机重复实验。图中范围表示达到稳定后各累计估计值的跨度,而不是单个请求或固定时间窗口的完整取值范围。
稳定范围通过绝对对数比计算,因此延迟及其倒数形式的交互性指标会在同一个检查点达到稳定。
配套发布
?unofficialrun=非官方运行叠加层。agentx-uncertainty-db-mvp(br-wandering-pine-aih0gnca);生产分支未被修改。验证
python -m pytest utils/agentic/aggregation/test_stability_metrics.py utils/agentic/aggregation/test_process_agentic_result.py— 47 项通过git diff --check— 通过